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^ ' Abstract 

f"^ ■ We derive the spectral properties of adjacency matrix of complex networks and of their Laplacian 

(N : 

j_^ . by the replica method combined with a dynamical population algorithm. By assuming the order 

^ I parameter to be a product of Gaussian distributions, the present theory provides a solution for the 

^D ' non linear integral equations for the spectra density in random matrix theory of the spectra of sparse 

random matrices making a step forward with respect to the effective medium approximation (EMA) 

Ch'. 

pH ^ and the single defect approximation (SDA). We extend these results also to weighted networks with 

weight-degree correlations 
<^ • PACS numbers: 

o 

o 
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o 
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The interest on the spectral properties of complex networks is growing for the study of 
their dynamics [l|, |2| being relevant for example to understand the stability of ecological 
networks or the synchronization stability conditions. |3|, |j] This problem is related with 



the investigation of spectral properties of random matrices in random matrices ensembles in 

in 

many fields of theoretical physics. [5', '6^ Starting from the discovery of the Wigner semicircle 
law in nuclear spectra [3] the Random Matrix Theory has have a wide range of applications 



from quantum chaos to irreversible classical dynamics and low density liquids 



iy,y,y 



The research on spectral properties of sparse random matrices has started as early as in 



the 1988 [III] but only recently their relevance has been fully acknowledged for the study of 
the properties of a number of dynamical models defined on the network, like in the models 
of synchronization. A number of methods for determining the density of states of random 
matrices have been proposed which range from the classical results of [12] to the replica 
method formulation and the supersymmetric formulation. The works of Monasson and Biroli 
llSl ] deals with the spectra of Laplacian matrices of random Poissonian networks and 



M,y,ii 



small world networks. In 13| a new approximation, the so called single defect approximation 
(SDA) for the study of the random spectra has been introduced. The approximation has 
been further improved by the work of Semerjian and Cugliandolo [16] for random Poissonian 
matrices. 

Dorogovtsev et al. [l|, [l7|, [l8|, have developed random walk based methods for the 
evaluation of the spectra of the adjacency matrix and the spectra of the Laplacian of complex 
networks. 



Using the replica method as in |l3l . Il5l . Il6l | the problem reduces to making a good replica 
symmetric ansatz for the functional order parameter defined on a vector of continuous vari- 
ables defined in the real axis. In the contest of a statistical mechanics model for studying 
the fluxes in the metabolic network [l9|, |20| a similar technical problem was solved assuming 



that the functional order parameter can be written as a weighted sum of Gaussians. The 
problem was then solved by proposing a population dynamics to find the statistical wei ghts 
corresponding to each Gaussian in the sum 20|. In this work, following reference 19|, l2G| 



we will derive the spectra of random matrices using the replica method and the develop- 
ment of the order parameter in term of weighted Gaussians, a technique that allows also 
for the extension to weighted matrices of random entries. This method can be applied both 
to adjacency matrices and to Laplacian matrices providing the tools for the calculation of 



different properties of the graph. 



I. SPECTRA OF A MATRIX 



Given a random matrix of eigenvalues A„ with n = 1 . . . N, the spectral density p(A) is 
defined as 



n 



and can also be expressed as 



p(A) = — ^ImTr- (2) 



We suppose that in the thermodynamics limit the spectral density is self-averaging, i.e. 

p(A) - (p(A)) (3) 

where the average is performed over all matrices in a given ensemble. To solve the spectra of 
the a matrix A in a given ensemble of random matrix we introduce the generating function 

r(A) 

^ „ N n 

r(A) = ^ / nn^<^^n«^p(^^<^M) n (e-^^'-^-^^^^^") (4) 

''' i=l a=l i,a <hj> 

with 

Z^ = jWdct^le^^^^'^^^. (5) 

i,a 

The spectral density is given by 

II. SPECTRA OF ADJACENCY MATRIX OF SPARSE NETWORKS 

To solve the spectra of the adjacency matrix of a random complex networks we introduce 
the generating function r(A) 

"^ i=l a=l i,a <hj> 

We assume that the support of our matrix is a random uncorrelated network with given 
expected degree assigned to each node of the network i.e. a realization of the random hidden- 



variable model 
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28| . In particular we fix the expected degree distribution of 



each node i of the undirected network to be qi and we assume that the matrix elements aij 
are distributed following 

Pia,,) = ^5(a., - 1) + (l - ^) 5(a.,), (8) 

for i < j {aij = aji) and where 6{) indicates the Kronecker delta. The partition function 
can then be average over the network ensembles 

(r(A)) = - / nn^'^^n^^p(i^<^M) (9) 

^ 1=1 a=l i,a 

V i,j a, ) 

We introduce the order parameters of the replicated variables on sparse networks IJ] 

^ i a 

getting for the partition function an expression of the type 

(r(A)) = y"pc,(0)exp[niVS({c,(0)})] 
with 

nE = -J^ /"d#,Cg(0)ln(c,(0))+2 5^p,c,(0)^A^0>'^ 

q q a 

- y^^y c?V^ J]p,p,,^^c,(0)c,,(^)(l - exp(^0-^)) + OiN-') (11) 

(12) 
The saddle point equations for evaluating S are given by 

c,(0) = exp|2^5^0>"-g[l-c(0)] 

^(<^) = E7|^/^^''^'''(^'')^^p(^<^-^)- (13) 

We assume that the solution of the saddle point equation is replica symmetric, i.e. the 
distribution of the variables (pa conditioned to a vector field x are identically equal dis- 
tributed, 

/n 
dxP{x)l[^{<Pa\x) (14) 



a=l 



where \l/(0|x) are distribution functions of and P{x) is a probability distribution of 
the vector field x. For the function \E'(0|x) the exponential form is usually assumed in Ising 
models. In our continuous variable case for our quadratic problem, we assume instead, as 
in 20|, that \E'((/)|x) has a Gaussian form. This assumption could be in general considered 
as an approximate solution of the equations (1131) . Explicitly we assume that the functions 



Cg(0) 
C(0) 



dhgPg{hg)Y\_exp 

a 

dhPih) JJ exp 



\h,rr 



-/i0>° 




(15) 



The saddle point equations (TT51) . taking into account the expression for the order param- 
eters (fTSi) closes as in the problem studied in [20| and can be written as recursive equation 
forP,(/i,),P(/i),i.e. 

k ' -^ - -^ 1=1 \ 1=1 J 



^(^) = Efy/^^n^'^(^ 



{hg)5 h 



1 



(16) 



Once the distributions Pq{hq) are found by the population dynamics algorithm, then the 
spectral density of the network can be expressed as 

P(^) = --E^^ [dhgP{hg)lm^ (17) 

^ q J 1 

Equations [16] can be solved as suggested in [20| by a population dynamics algorithm. The 
action of the algorithm for finding P{h) is summarized in the following pseudocode 
algorithm PopDyn({/i}) begin do 

• select a random index a G (1, M) 

• choose a random q with probability qpq 

• draw k from a Poisson distribution {e~^^q^ /k\) 

• select k indexes /3i, . . . /3fc G {1, . . . M} 

1 



i\ + Eti hi 



(18) 



while (not converged) return end 

The effective medium approximation (EM A) as found in [17] will be given by the solution 

of the population dynamics with M = 1, i.e. 

qpq 1 



l-EMA 



E 



(q) iX + qh 



EMA 



The density in this approximation take the form 



pW = "^Pq^^ 



1 



A - iqhEMA 



(19) 



(20) 



III. SPECTRA OF THE LAPLACIAN 



The Laplacian of a complex networks plays a crucial role in diffusion process on the 
network and on the stability of many dynamical fixed points [3|, U, [l8|. The Laplacian 
is defined in terms of the adjacency matrix aij of the network as the matrix of entries 
Lij = —ciij + Ylk^ik^ij- ■^'-'^ ^^^ Laplacian matrix the generating function r(A) takes the 
form, 

r(A) = Y IlIld<t>^Il^Ml>^m) n (e-^»^^^^^^"). (21) 

^ i=l a=l i,a <i,j> 

Performing the average over the networks in hidden variable ensemble with fixed expected 
degree, Eq. (IHl), we obtain 



1 r ^ 1 

"*' 1=1 i,a 



1=1 
1 



exp 



E 



«j 



{q)N 



1 — exp 



la J,a\2 



+ 0{N^) 



(22) 



Introducing the order parameters Cg(0) defined in Eq. flTUl) we get for the partition function 

(r(A)) = y"pc,(0)exp[niVS({c,(0)})] 
with 



nS = -^ /rf0p,c,(0)ln(c,(0)) + ^A^PgCg(0)^0'^ 



Iqq' 



d'if^PqPq'--ri-Cq{(j))Cqil/j) <j 1 - eXp 



qq' 



-^{$-^f 



0(iV-^).(23) 
(24) 



The saddle point equation determining the order parameter are 



Cg 



((?) = exp|^^5^rr-g[l-c(0)]l 
(0) = X]~rf / dip Cg'{i))exi) 



^{<i>-^y 



(25) 



Again these equations can be solved with the Gaussian ansatz introduced in [20|], Eq. (TT5l) . 

k / k \ 

k ' -^ - -^ 1=1 \ 1=1 J 

P^h) = E ^ / ^^ n ^^(^)'^ (^ - 7^ + ^) (26) 

q I 

Finally the spectral density is given by 

P(^) = --E^^ [ dh,P{h,)lm^. (27) 

^ q -J 1 

Equations fl2^ can again be solved by a population dynamics algorithm The action of the 
algorithm for finding P{h) is summarized in the following pseudocode 
algorithm PopDyn({/i}) begin do 

• select a random index a G ( 1 , M) 

• choose a random q with probability qpq 

• draw k from a Poisson distribution [e~'^^q^ /k\) 

• select fc indexes Pi, . . . Pk £ {!,••• ^} 



^(A - 1) + Ef=i /^? 



(28) 



while (not converged) return end Once the distribution of h is found from the first equation 
of fl2Bl) it is strait-forward to calculate the distributions for Pq{hq). The effective medium 
approximation {EM A) as found in will be given by the solution of the population dynamics 
with M = 1, i.e. 

^ {q)t{\-l) + qhEMA 



The density in this approximation take the form 



P(A) = $^P.Im- i (30) 

A - iqhEMA 



IV. WEIGHTED NETWORKS 

The over-mentioned results can be extended to weighted networks with weight degree 
correlations. The correlation between the weight of the links A^ ending to a node i and the 
degree of the node i have been observed in different networks [29] and can also be explained 



by growing network models [30l]. A network ensemble with weight degree correlations can 
be formulated by assuming that the weight of a link between node i and node j, if present, 
has a value Wij = C{qiqjY where qi and qj are the expected conductivities of node i and j 
and C, 9 are two parameters specifying the ensemble under consideration. Therefore in the 
following we will consider the symmetrix matrix Wij with distribution of the matrix elements 
given by 

^(^..) = ^^(«^.. - C{q^q,)') + (l - ^) ^(^..)- (31) 

for i < j and Wij = Wji The generating function r(A) for this ensemble of networks is given 
by 

^ ^ N n 

r(^) =yI iiii^^^ii^m'^^^-<i>-) n (e-^^«*>»^'^") . (32) 

''' j=l a=l i,a <i,j> 

with its average over the distribution fl3T]) taking the usual form 



(r(A)) = J I)c,(0)exp[niVS({c,(0)})]. 
with Cq{(j)) given by flTUl) and 

nS = -5^y"rf#,c,(0)ln(c,(0)) + ^A5^p,c,(0)^0>'^ 



Q q 



-i |d0|#5^p,p,i^c,(0)c,,(V^)[l - exp(^(C(gg')'0 ■ ^)')] + (^(iV"')(33) 
The saddle point equation to be solved are 



c,(0) = exp I ^A J2 ^y^" - ?[1 - c.(0 

Cq{(f>) = ^Pq'-T) / Cg'W#exp iC{qq'f(j)-ip 



The recursive equations to be solved ad the saddle point are 



q' 
The spectral density is given by 



q - "5 



The equations ( l35l) can be solved by a population-dynamical algorithm. 
The action of the algorithm is summarized in the following pseudo code 

algorithm PopDyn({/iq}) begin do 

• select a random q and a random index a G (1, M) 

• choose a random q' with probability q'pqi 

• draw A; from a Poisson distribution (e"'' q'^/k\) 

• select fc indexes /3i, . . . /3fc G {1, . . . M} 



(34) 






z'^^) = -^Ep«/^^^(^)i^/r (^^) 



(37) 



while (not converged) return end The equivalent of the effective medium approximation 
are the following equation for hq 

UEMA) _ sr^ Q-'Pq' C^jqq'Y /oo\ 



q' 



and the spectral density is given by 



P(A) = Yl Pl^"^-, . HE MA) (39) 



A — iqh. 



(EMA) 

q 



In conclusion we have provided a solution for the non linear integral equations for the spectra 
density in random matrix theory of the spectra of sparse random matrices introducing the 
order parameter as product of Gaussian distributions, the applications of this approach will 
be relevant in many fields and stability of stationary state in dynamical system defined on 
complex networks. 

After this work was completed we become aware of similar findings obtained by R. Kuehn 



|3l|. 
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